Optimization of data migration between storage mediums

ABSTRACT

In one embodiment, pursuant to migrating the data from the first to the second storage medium, the data is allocated to the second storage medium while retaining an allocation of the data in the first storage medium. If the data is migrated from the second storage medium back to the first storage medium, the data is pointed to the allocation of the data in the first storage medium to alleviate data movement from the second storage medium to the first storage medium. If the allocation of the data in the first storage medium is determined to be needed for other data, the allocation of the data in the first storage medium is freed.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a Continuation of U.S. patent applicationSer. No. 12/697,989, filed on Feb. 1, 2010.

FIELD OF THE INVENTION

The present invention relates in general to computers, and moreparticularly to apparatus, method and computer program productembodiments for allocating and migrating data between pools in acomputing storage environment using a tiered architecture.

DESCRIPTION OF THE RELATED ART

Computers and computer systems are found in a variety of settings intoday's society. Computing environments and networks may be found athome, at work, at school, in government, and in other settings.Computing environments increasingly store data in one or more storageenvironments, which in many cases are remote from the local interfacepresented to a user.

These computing storage environments may use many storage devices suchas disk drives, often working in concert, to store, retrieve, and updatea large body of data, which may then be provided to a host computerrequesting or sending the data. In some cases, a number of data storagesubsystems are collectively managed as a single data storage system.These subsystems may be managed by host “sysplex” (system complex)configurations that combine several processing units or clusters ofprocessing units. In this way, multi-tiered/multi-system computingenvironments, often including a variety of types of storage devices, maybe used to organize and process large quantities of data.

SUMMARY OF THE DESCRIBED EMBODIMENTS

Current tiered-storage architectures, as described above, include avariety of storage mediums. These may include such media as enterprisedisk drives, serial advanced technology attachment (SATA) disk drives,solid state drives, tape drives, and other devices. Data may be migratedbetween such devices. Placement of certain kinds of data in theappropriate medium may greatly enhance overall performance of thestorage environment.

While it is recognized that such placement of data enhances storageperformance, the mechanisms whereby data is migrated between storagemediums may be improved. The processes of moving data between storagemediums causes increased workload and bandwidth consumption in thestorage environment. A need exists, for example, for a mechanism wherebydata may be migrated as needed between storage mediums while reducingoverall workload on the system.

Accordingly, and in view of the foregoing, various method embodimentsfor data migration between storage mediums are provided. In oneembodiment, by way of example only, a method for data migration betweenfirst and second storage mediums of an available plurality of storagemediums in a computing storage environment is provided. In oneembodiment, pursuant to migrating the data from the first to the secondstorage medium, the data is allocated to the second storage medium whileretaining an allocation of the data in the first storage medium. If thedata is migrated from the second storage medium back to the firststorage medium, the data is pointed to the allocation of the data in thefirst storage medium to alleviate data movement from the second storagemedium to the first storage medium. If the allocation of the data in thefirst storage medium is determined to be needed for other data, theallocation of the data in the first storage medium is freed.

In addition to the foregoing exemplary embodiment, various other methodembodiments are provided and supply related advantages.

BRIEF DESCRIPTION OF THE DRAWINGS

In order that the advantages of the invention will be readilyunderstood, a more particular description of the invention brieflydescribed above will be rendered by reference to specific embodimentsthat are illustrated in the appended drawings. Understanding that thesedrawings depict embodiments of the invention and are not therefore to beconsidered to be limiting of its scope, the invention will be describedand explained with additional specificity and detail through the use ofthe accompanying drawings, in which:

FIG. 1 illustrates a block diagram of an exemplary computing storageenvironment in accordance with certain embodiments;

FIG. 2 illustrates a flow chart diagram of an exemplary method formigrating data between storage mediums according to one embodiment ofthe present invention; and

FIG. 3 illustrates an additional flow chart diagram of a furtherexemplary method for migrating data between storage mediums including amirror management mechanism.

DETAILED DESCRIPTION OF THE DRAWINGS

The illustrated embodiments provide mechanisms for migrating portions ofdata (such as by extents) between storage mediums such that space forthe data is retained (allocated) on both storage mediums, as opposed tothe data segment being freed as is currently performed from the originalstorage medium from which the data segment is moved.

In one embodiment, the data segments are accessed from which of thestorage mediums are determined to be appropriate at any one particulartime. If at a future time, the data segments are determined to havechanged (for example, one or more characteristics of the data change),and a determination is made that the data segments should be migratedback to the original storage medium, metadata for the data segments maysimply be changed to “point” back at the previously allocated space,alleviating any physical data movement. If the data segments are everwritten to during an operation while the data segments are outside atarget medium, the allocated space in the original medium may then befreed. If the data space is needed by a user or system process on theoriginal medium, the space may also likewise be freed.

Turning now to FIG. 1, a block diagram of a computing storageenvironment 100 in accordance with certain embodiments is illustrated.The computing storage environment 100 includes a first computationaldevice, such as, a storage server 102, coupled to one or morecomputational devices, such as, clients 104. In certain embodiments, thestorage server 102 and the clients 104 may comprise any suitablecomputational device, including those presently known in the art, suchas, a personal computer, a workstation, a mainframe, a midrangecomputer, a network appliance, a palm top computer, a telephony device,a blade computer, a hand held computer, etc.

In some embodiments, a storage manager 106, such as, the Tivoli® StorageManager® (TSM) product marketed by International Business Machines(IBM®) Corporation may be used for securely storing and managing datasegment's according to aspects of the present invention. The storagemanager 106 may execute in a storage management server, such as a TSMserver 102 or elsewhere. In one embodiment, the storage manager isoperable by and/or in conjunction with processor device 105 as shown.One of ordinary skill in the art will appreciate that various otherconfigurations of the processor 105, storage manager 106, and relatedadditional processing and/or memory components are contemplated. IBM,Tivoli, and Tivoli Storage Manager are trademarks or registeredtrademarks of IBM Corporation.

The TSM may provide data storage services to clients, such as TSMclients 104 a, for management of data. The TSM server 102 may storefiles sent to the TSM server 102 by one or more TSM clients 104 a. Thestorage manager 106 and/or processor device 105 may allow a systemadministrator to configure storage pools, where a storage pool comprisesa group of devices used for storing data received from the TSM client104 a. Storage pools are used as targets for store operations from theTSM client 104 a and are referenced in TSM server policies and otherconstructs for processing.

As shown, a variety of storage devices may be organized into a storagehierarchy. Storage media within the storage hierarchy may thus begrouped into data structures referred to herein as storage pools. Thestorage hierarchy may be organized to correspond with one or moremetrics, such as a performance metric including write or read speeds.The storage hierarchy 108 as shown may be organized such that the top ofthe hierarchy may include a cache pool 110 having a highest amount orquality of a particular performance metric. Below the cache pool 110, anumber of solid state drive (SSD) class devices may be organized intoSSD pools by the same, similar, or other metrics (e.g., SSD pools 112and 114).

Below the SSD pools 112 and 114, a first tier of disk pools (e.g., diskpools 116, 118, and 120) may be then organized. As one of ordinary skillin the art will appreciate, disk pools 116, 118, and 120 may include avariety of disk devices such as pools of enterprise disk drives, SATAdisk drives, disk devices configured in a particular redundant array ofindependent disks (RAID) configuration, and the like.

The first tier of disk pools may be located above a second tier of diskpools (e.g., pools 122, 124, and 126) by virtue of exhibiting a greateramount, stronger attribute or attributes, or quality of the performancemetric. Below the second tier of disk pools, an additional tier of tapepools (e.g., tape pools 128, 130, and 132) may then be organized.Various considerations for the organization of such storage hierarchies108 may be apparent to one of ordinary skill in the art. In oneembodiment, the system administrator may assist in performing suchconfigurations in the storage hierarchy 108 by inputs to the TSMadministrative client 104 b or another mechanism.

As previously mentioned, the illustrated embodiments provide mechanismsfor migration of data between storage mediums such as that found in thestorage hierarchy 108. In one embodiment including a tier of disk poolscorresponding to enterprise hard disk drives (HDDs) and a tier of diskpools corresponding to a number of SSD devices, pursuant to a datamigration from the enterprise HDDs to the SSDs, the data may be leftallocated on the enterprise HDDs (original storage medium), while anyallocated but unused storage space on the SDDs are freed taking intoconsideration the higher demand that storage space on SDD devicescreates. In this case, if the data is then later migrated back to theenterprise HDDs (if the data had not been written to, and the originalspace was not later requested, for example), the backwards migration istrivial, requiring no data movement and conserving bandwidth andworkload.

Variations of the above exemplary embodiment may be considered. Forexample, pursuant to a migration from HDD to SSD, after reserving thedata segment on the SSD and copying the data from the HDD data segmentto the new SSD data segment, the HDD data segment may be marked as“mirroring” the given SSD data segment. If a write operation isperformed to the SSD data segment, the mirrored MD extent may then befreed and the “mirroring” indicator cleared.

Further, if the data space is requested on the HDD (by, for example, auser or a system process such as an Extent Space Efficient volumebackground allocation), and only “mirrored” space remains (i.e., noother available storage space), then the mirrored data segments may besearched to select one or more to be freed. The selection algorithm maytake into account various data characteristics such as the data'sread/write ratio, selecting the data segment most likely to be writtento in the future. Additionally, the selection algorithm may simply use aFirst-In, First-Out (FIFO) algorithm considering the oldest mirroreddata segments first. Whichever selection mechanism is utilized, the datasegment's mirroring indicator may then be cleared and the data segmentis then allocated for the new purpose.

If the SSD data segment is backwards migrated to the HDD, and nomirroring relationship is located for the particular SSD data segment,an available data segment may then be found, allocated, and the datamigrated to the new data segment. If a mirroring relationship for theSSD segment exists, the metadata of the volume may be updated toindicate the location of the data segment to be the original datasegment. In either case, the SSD data segment may then be freed afterthe HDD data segment takes up the task of accommodating the data.

The mechanism of querying to determine if a mirroring relationshipexists may be implemented as a background process, and not necessitatingadditional interface requirements as one of ordinary skill in the artwill appreciate. A user querying available space may, accordingly, bereturned a sum of available data segments and data segments determinedto be in a mirroring relationship.

In some embodiments, a bitmap may be created for the original storagespace (for example, in metadata), with a bit in each arbitrarily sizedsubsection (such as a track) of the data segment. The space leftallocated on the original storage space may then be determined to beallocated or reserved when queried by the user. If the data segment onthe migrated storage medium (such as an SSD drive) is written to, thesubsection(s) of the data segments may be marked as “dirty” in themetadata bitmap. If the data segment is then migrated back to theoriginal storage medium, the bitmap may then be used to determine whichdata segments are altered, and thus require physical data migration fromthe migrated storage medium.

Turning to FIGS. 2 and 3, following, exemplary methods 200 and 220 fordata migration between storage mediums are illustrated in flow chartdiagram format. As one of ordinary skill in the art will appreciate,various steps in the methods 200 and 220 may be implemented in differingways to suit a particular application. In addition, the describedmethods 200 and 220 may be implemented by various means, such ashardware, software, firmware, or a combination thereof operational on orotherwise associated with the computing storage environment. Forexample, the methods 200 and 220 may be implemented, partially orwholly, as a computer program product including a computer-readablestorage medium having computer-readable program code portions storedtherein. The computer-readable storage medium may include disk drives,flash memory, digital versatile disks (DVDs), compact disks (CDs), andother types of storage mediums.

Turning first to FIG. 2, method 200 begins (step 202), with the receiptof a storage request (e.g., a read or write request) in the computingstorage environment (step 204). If, pursuant to the write request, thewrite is to be written in the original storage medium (step 206),indicating that the original allocation of data in the original storagemedium is necessary for this new data, then the metadata bitmap(s)corresponding to that data are cleared (step 208), and the previousallocation of storage in the original storage medium is freed (step 210)to accommodate the newly written data on the original storage medium.

Returning to step 204, if pursuant to the write request, the write is tobe written in the migrated storage medium (step 216), then thosecorresponding metadata bits in the original storage medium are marked asdirty (step 218). An exemplary methodology describing the allocation ofsuch storage and creation of such bitmaps is further described,following, in FIG. 3. Following the conclusion of step 210 or step 218,the storage request is satisfied (i.e., the read or write operation isconducted) (step 212), and statistics reflecting the I/O activitypreviously described are updated (step 214).

These statistics may later form the basis for later considerations ofwhere to put subsequent data, be it on the original storage medium ormigrated storage medium. Exemplary statistical data may includeread/write ratios, size of the data segment, and the like as one ofordinary skill in the art will appreciate. For example, data having alarge number of reads but a lower number of writes may be determined tobe a good candidate for SSD storage. Following the conclusion of step214, the method 200 returns to step 204 to accommodate an additionalstorage operation.

Turning to FIG. 3, following, an exemplary method 220 for mirrormanagement is provided in consideration with the method 200 previouslydescribed. Method 220 begins with the analysis of the statiscialinformation previously described above (step 202). Pursuant to thisanalysis, a determination may be then made as to whether to manage themirrored data in some way. If an existing mirror is determined to benecessary to be deleted (for example, a mirror of data on an SSD devicedetermined to no longer necessitate SSD performance) (step 224), thenthe method 220 confirms that a mirroring relationship exists between thetwo storage mediums (step 230).

If the data is determined not to be previously mirrored, or/and a mirroris unnecessary, then an available allocation of storage on theappropriate, unmirrored medium (e.g., the original storage medium, forexample) is allocated 240, and the corresponding data is written to theallocation (step 242). The method 220 then ends (step 228).

Returning to step 230, if the data is determined to be mirrored (e.g.,mirrored on the original and migrated storage medium), and the mirror isto be deleted, then the data is pointed to the allocation in theoriginal storage medium, alleviating physical data movement from themigrated storage medium to the original storage medium (step 232).Pursuant to the migration of the data back to the original storagemedium, those bits having been earlier marked as dirty (e.g., step 218,FIG. 2), are then written to the original storage medium, ensuring thatan accurate migration is made of the complete data. Any associatedbitmaps corresponding to the migrated storage medium (to be deleted) arethen deleted (step 236), and the storage in the migrated storage mediumis freed (step 238). The method 220 then ends (again, step 228).

Returning to step 202, if the statistical analysis determines that datashould be migrated (e.g., data presents statistical informationindicating better performance in another storage medium), (step 226),the data in question (such as one or more extents) are allocated to themigrated storage medium, while an allocation of the data is retained inthe original storage medium (step 244). In the depicted embodiment, andpursuant to such data migration following the write of data to theallocation (step 246), the allocation of the data in the originalstorage medium is then marked as mirrored in the migrated storage mediumand a bitmap for the data units of the allocation in the originalstorage medium is created (step 248). The method 220 then ends (again,step 228)

As one of ordinary skill in the art will appreciate, the methods 200 and220 may be additionally performed on a scheduled interval in lieu of thestorage request previously described. The scheduling may occur pursuantto various implementations of the computing storage environment. Forexample, the scheduling may coincide with periods of high and/or lowstorage activity. The scheduling may be configured by a systemadministrator using the storage manager 106 (FIG. 1) or by other similarmeans.

As will be appreciated by one skilled in the art, aspects of the presentinvention may be embodied as a system, method or computer programproduct. Accordingly, aspects of the present invention may take the formof an entirely hardware embodiment, an entirely software embodiment(including firmware, resident software, micro-code, etc.) or anembodiment combining software and hardware aspects that may allgenerally be referred to herein as a “circuit,” “module” or “system.”Furthermore, aspects of the present invention may take the form of acomputer program product embodied in one or more computer readablemedium(s) having computer readable program code embodied thereon.

Any combination of one or more computer readable medium(s) may beutilized. The computer readable medium may be a computer readable signalmedium or a computer readable storage medium. A computer readablestorage medium may be, for example, but not limited to, an electronic,magnetic, optical, electromagnetic, infrared, or semiconductor system,apparatus, or device, or any suitable combination of the foregoing. Morespecific examples (a non-exhaustive list) of the computer readablestorage medium would include the following: an electrical connectionhaving one or more wires, a portable computer diskette, a hard disk, arandom access memory (RAM), a read-only memory (ROM), an erasableprogrammable read-only memory (EPROM or Flash memory), an optical fiber,a portable compact disc read-only memory (CD-ROM), an optical storagedevice, a magnetic storage device, or any suitable combination of theforegoing. In the context of this document, a computer readable storagemedium may be any tangible medium that can contain, or store a programfor use by or in connection with an instruction execution system,apparatus, or device.

Program code embodied on a computer readable medium may be transmittedusing any appropriate medium, including but not limited to wireless,wired, optical fiber cable, RF, etc., or any suitable combination of theforegoing. Computer program code for carrying out operations for aspectsof the present invention may be written in any combination of one ormore programming languages, including an object oriented programminglanguage such as Java, Smalltalk, C++ or the like and conventionalprocedural programming languages, such as the “C” programming languageor similar programming languages. The program code may execute entirelyon the user's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Aspects of the present invention are described below with reference toflowchart illustrations and/or block diagrams of methods, apparatus(systems) and computer program products according to embodiments of theinvention. It will be understood that each block of the flowchartillustrations and/or block diagrams, and combinations of blocks in theflowchart illustrations and/or block diagrams, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general purpose computer, specialpurpose computer, or other programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable data processingapparatus, create means for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

These computer program instructions may also be stored in a computerreadable medium that can direct a computer, other programmable dataprocessing apparatus, or other devices to function in a particularmanner, such that the instructions stored in the computer readablemedium produce an article of manufacture including instructions whichimplement the function/act specified in the flowchart and/or blockdiagram block or blocks. The computer program instructions may also beloaded onto a computer, other programmable data processing apparatus, orother devices to cause a series of operational steps to be performed onthe computer, other programmable apparatus or other devices to produce acomputer implemented process such that the instructions which execute onthe computer or other programmable apparatus provide processes forimplementing the functions/acts specified in the flowchart and/or blockdiagram block or blocks.

The flowchart and block diagram in the above figures illustrate thearchitecture, functionality, and operation of possible implementationsof systems, methods and computer program products according to variousembodiments of the present invention. In this regard, each block in theflowchart or block diagrams may represent a module, segment, or portionof code, which comprises one or more executable instructions forimplementing the specified logical function(s). It should also be notedthat, in some alternative implementations, the functions noted in theblock may occur out of the order noted in the figures. For example, twoblocks shown in succession may, in fact, be executed substantiallyconcurrently, or the blocks may sometimes be executed in the reverseorder, depending upon the functionality involved. It will also be notedthat each block of the block diagrams and/or flowchart illustration, andcombinations of blocks in the block diagrams and/or flowchartillustration, can be implemented by special purpose hardware-basedsystems that perform the specified functions or acts, or combinations ofspecial purpose hardware and computer instructions.

While one or more embodiments of the present invention have beenillustrated in detail, one of ordinary skill in the art will appreciatethat modifications and adaptations to those embodiments may be madewithout departing from the scope of the present invention as set forthin the following claims.

What is claimed is:
 1. A method of data migration between first andsecond storage mediums of an available plurality of storage mediums in acomputing storage environment by a processor device, comprising:migrating the data from the first to the second storage medium, andallocating the data to the second storage medium while retaining anallocation of the data in the first storage medium; marking a mirroringindicator of the data on the first storage medium as mirroring theallocation of the data in the second storage medium, after the data onthe first storage medium has been migrated to the second storage medium;using a bitmap to track whether space on the first storage medium hasalready been allocated or reserved; and pursuant to migrating data fromthe first to the second storage medium: a determination is made as towhether the data exists in both the first storage medium and the secondstorage medium thereby being mirrored, if the data is mirrored and themirror is to be deleted, the data is pointed to the allocation of thedata in the first storage medium to alleviate data movement from thesecond storage medium to the first storage medium, if a determination ismade that only mirrored space remains in the first storage medium,mirrored data segments in the first storage medium are searched todetermine whether an allocation of one or more of the mirrored datasegments in the first storage medium is needed for other data, whereinto determine whether the allocation is needed for other data is based ona read/write ratio of the one or more mirrored data segments, the one ormore mirrored data segments are allocated to a new purpose, and theallocation of the one or more mirrored data segments in the firststorage medium is freed by clearing a mirroring indicator associatedwith the freed allocation of the one or more mirrored data segments, andif the data is mirrored and one of an allocation of the data in thesecond storage medium and the allocation of the data in the firststorage medium is altered, the other one of the allocation of the datain the second storage medium and the allocation of the data in the firststorage medium is freed.
 2. The method of claim 1, further including:marking in the bitmap those of the data units of the allocation of thedata in the first storage medium corresponding to data units of anallocation of the data in the second storage medium having been alteredas dirty, and upon migrating the data from the second storage mediumback to the first storage medium, migrating the marked data units. 3.The method of claim 1, further including, pursuant to determining if theallocation of the data in the first storage medium is needed for otherdata: implementing a first-in, first-out (FIFO) methodology, wherein theallocation of the data in the first storage medium is determined to bean oldest allocation.
 4. The method of claim 1, further includingdetermining at a point in time, in view of at least one datacharacteristic, which of the first and second storage mediums from whichto access the data.
 5. The method of claim 4, wherein the at least onedata characteristic includes a higher number of reads than writes, andallocating the data to the second storage medium while retaining theallocation of the data in the first storage medium includes allocatingthe data to at least one solid state drive (SSD) while retaining anallocation of the data on at least one enterprise hard disk drive (HDD).6. The method of claim 1, wherein further comprising, pursuant todetermining if the allocation of the data in the first storage medium isneeded for other data, selecting a data segment in the allocation of thedata in the first storage medium that is most likely to be written to inthe future.
 7. A method of migrating data from an original storagemedium to a migrated storage medium comprising: migrating the data fromthe original to the migrated storage medium, and allocating the data tothe migrated storage medium while retaining an allocation of the data inthe original storage medium; marking a mirroring indicator of the dataon the original storage medium as mirroring the allocation of the datain the migrated storage medium, after the data on the original storagemedium has been migrated to the migrated storage medium; using a bitmapto track whether space on the original storage medium has already beenallocated or reserved; determining whether data exists on both theoriginal storage medium and the migrated storage medium thereby beingmirrored and whether the mirror is to be deleted; pointing the data toan allocation in the original storage medium, if the data is mirroredand the mirror is to be deleted to alleviate movement of the data fromthe migrated storage medium to the original storage medium; and if adetermination is made that only mirrored space remains in the originalstorage medium, searching mirrored data segments in the original storagemedium to determine whether an allocation of one or more of the mirroreddata segments is needed for other data, wherein to determine whether theallocation is needed for other data is based on a read/write ratio ofthe one or more mirrored data segments, allocating the one or more ofthe mirrored data segments to a new purpose, and freeing storage in themigrated storage medium associated with the one or more mirrored datasegments by clearing a mirroring indicator associated with the freedallocation of the one or more mirrored data segments.
 8. The method ofclaim 7, wherein if the data is determined not to be mirrored and/or amirror is not necessary, allocating an available allocation of storageon the original storage medium to the data and writing the data to theavailable allocation of storage on the original storage medium.
 9. Themethod of claim 7, further comprising: receiving a storage requestassociated with new data; indicating that an original allocation of datain the original storage medium is necessary for the new data andclearing a metadata bitmap corresponding to the new data; and freeing aprevious allocation of storage in the original storage medium toaccommodate the new data on the original storage medium.
 10. The methodof claim 9, further comprising: marking the corresponding metadatabitmap in the original storage medium as dirty, if the new data is to bewritten in the migrated storage medium.
 11. The method of claim 10,further comprising: writing the new data to the original storage medium;deleting an associated metadata bitmap corresponding to the migratedstorage medium; and freeing an allocation in the migrated storagemedium.
 12. The method of claim 10, further comprising: updatingstatistics reflecting input/output activity relating to the data and thenew data; and determining whether a portion of the data and/or the newdata should be migrated, based on an analysis of the statistics.
 13. Themethod of claim 12, further comprising: allocating the portion of thedata and/or the new data to the migrated storage medium and retaining anallocation of the portion of the data and/or the new data in theoriginal storage medium, if a determining is made that the portion ofthe data/and or the new data should be migrated; and marking theallocation of the portion of the data and/or the new data in theoriginal storage medium as mirrored in the migrated storage medium.